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We consider estimation of a multivariate normal mean vector un- 
der sum of squared error loss. We propose a new class of smooth 
estimators parameterized by a dominating the James-Stein estima- 
tor. The estimator for a = 1 corresponds to the generalized Bayes 
estimator with respect to the harmonic prior. When a goes to infinity, 
the estimator converges to the James-Stein positive-part estimator. 
Thus the class of our estimators is a bridge between the admissible 
estimator {a = 1) and the inadmissible estimator (a = oo). Although 
the estimators have quasi-admissibility which is a weaker optimality 
than admissibility, the problem of determining whether or not the 
estimator for a > 1 admissible is still open. 



1. Introduction. Let X be a random variable having p-variate normal 
distribution Np(6, Ip). Then we consider the problem of estimating the mean 
vector 6 by S{X) relative to quadratic loss. Therefore every estimator is 
evaluated based on the risk function 

R(S,S) = [MX) - Of] = ^l^exp (-t^) ^. 

The usual estimator X, with the constant risk p, is minimax for any dimen- 
sion p. It is also admissible when p = 1 and 2, as shown in [l| and [l^ . 
respectively, fisf] showed, however, that when p > 3, there exists an estima- 
tor dominating X among a class of equivariant estimators relative to the 
orthogonal transformation group which have the form 

(1.1) 64X) = {l-cP{\\Xf)/\\Xf)X 

[3] succeeded in giving an explicit form of an estimator improving on X as 

Sjs{X) = {l-{p-2)/\\Xf)X, 

which is called the James-Stein estimator. More generally, a large class of 
better estimators than X has been proposed in the literature. The strongest 
tool for this is p^]'s identity as follows. 
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Lemma 1.1 ( IJ])- IfY ^ -^(a*) 1) '^'^^^ h,{y) is any dijjerentiable function 
such that E[\h'(Y)\] < oo, then 



E[h{Y){Y-f,)]=E[h'{Y)]. 



:i.2) 



By using the identity (|1.2p , the risk function of the estimator of the form 
6g{X) = X + g{X) = {Xi + gi{X), ...,Xp + gp{X))' is written as 



Ee[\5g{X)-e\\\ 

Ee[\X-ef] +Ee\\\g{X)f]+2j2Ee[[X-eyg{X)\ 

i=l 

d 



p + Ee \\g{X)f +2Y^Ee 



p 

i=l 



■g^{x) 



where gi{x) is assumed to be differentiate and E\[d / dxi)gi{X)\ < oo for 
i = 1, . . . ,p. Since a statistic R{5{X)) given by 



(1.3) 



p+\\g{X)f+2j2^miX) 



i=l 



does not depend on the unknown parameter 6 and satisfies E(R(6{X))) 
R{9,6), it is called the unbiased estimator of risk. Clearly if 



:i.4) 



\\g(x)f+2j2l^9^i^)<0, 



1=1 



for any x, then 6g{X) dominates X. 

To make the structure of estimators improving on X more comprehensible, 
we consider a class of orthogonally equivariant estimators of a form given in 
(|1.1|) . Assigning g{x) = - 



:i.5) 



-(/)(||x||^)x/||x|p in (fTH) becomes 

(w) {2{p - 2) - (t){w)) /w + 4(t)'{w) > 0, 



for w = The inequality (jl.Sp is, for example, satisfied if is mono- 

tone nondecr easing and within [0, 2(p — 2)] for any w > 0. 

Since 4>{w) = c for < c < 2{p — 2) satisfies the inequality (jl.Sp . 



:i.6) 



fl-c/||X||^)X 
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with < c < 2{p — 2) dominates X. The estimator 5js, (|1.6p with c = p — 2, 
is the best estimator among a class of estimators (|1.6|) because the risk 
function of (jl.6p is given by 

p + c{c-2{p-2))E[\\X\\-^] 

and hence minimized hy c = p — 2. 

It is however noted that when |jx|p < p — 2, the James-Stein estimator 
yields an over-shrinkage and changes the sign of each component of X. The 
James-Stein positive-part estimator 

6js{X) = max(0, 1 - {p - 2)/\\Xf)X, 

eliminates this drawback and dominates the James-Stein estimator. We no- 
tice here that the technique for proving the inadmissibility of 6js is not from 
the Stein identity or the unbiased estimator of risk given in (|1.3p . The risk 
difference between 6js and 5s is given by 



fl(«js,e)-JS(i^,e) = E 



1^1 



but (j)'jg{w) = m.m{w,p — 2) which makes the James-Stein positive-part 
estimator does not satisfy the inequality 

(1.7) -{(l){w) -p + 2f + 4w(l)'{w) >0 

for any w > 0. In Section 2, we will show that there is no (p which satisfies 
p.7p for any u; > 0, that is, the Stein identity itself is not useful for finding 
estimators dominating 6js- We call such optimality for the James-Stein es- 
timator quasi-admissibility. We will explain the concept and give a sufficient 
condition for quasi-admissibility in Section 2. 

In spite of such difficulty, some estimators which dominate the James- 



Stein estimator have been given by several authors. ll| and [6] considered 
the class of estimators of forms S^KiX) = (1 — (/ixxdl-'^lP)/!!-^!!^)-^ where 



n 

(t>LK{w) = p - 2 - ^aiW 

i=l 



where > for any i and < 6i < 62 < ■ ■ ■ < ^n- For example when 
n = 1, they both showed that, Slk{X) for < 61 < A~^{p — 2) and 
ai = 26i2''ir(p/2 — bi — \)/T{p/2 — 2bi — 1) is superior to the James-Stein 
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estimator. [10[ gave two estimators which shrink toward the baU with center 
0, 6'j^t{X) = (l-<^*^y(||X||2)/||X|[2)X fori = 1,2 where 



(l)KTiw) 



[0 w<r2 
[p-2-j:'iZi{r/wy^y w>r'^, 



a = u;<{(p-l)/(p-2)}V 



'■>KT{ 



They showed that when r is sufficiently smah, these two estimators dominate 
the James-Stein estimator. However, these estimators are not appeahng since 
they are inadmissible. In our setting, the estimation of a multivariate normal 
mean, showed that any admissible estimator should be generalized Bayes. 
Since the shrinkage factor {l — (/)LKi'w)/w) becomes negative for some w and 
(pXT i = 1,2 fail to be analytic, neither 5lk nor 5]^rp can be generalized 
Bayes or admissible. 

In general, when we propose an estimator ((5^,, say) dominating a cer- 
tain inadmissible estimator, it is extremely important to find it among ad- 
missible estimators. If not, a more difficult problem (finding an estimator 
improving on (5*) just occurs. To the best of our knowledge, the sole ad- 
missible estimator dominating the James-Stein estimator is [2,]'s estimator 
6k{X) = (1 - (t>K{\\Xf)/\\Xf)X where 

(1.8) <PkH=p-2 ^ 



/o AP/2-2exp(-u;A/2)dA 

The estimator is generalized Bayes with respect to the harmonic prior den- 
sity ll^lP"^ which was originally suggested by [l^. The only fault is, however, 
that it does not improve upon 5js{X) at \\6\\ = 0. (See Section 3 for the 
detail.) Shrinkage estimators like (jl.ip make use of the vague prior infor- 
mation that ll^ll is close to 0. It goes without saying that we would like 
to get the significant improvement of risk when the prior information is 
accurate. Though d^iX) is an admissible generalized Bayes estimator and 
thus smooth, it has no improvement on 5js{X) at the origin \\9\\ = 0. On 
the other hand, 5^g{X) improves on 6js{X) significantly at the origin, but 
it is not analytic and is thus inadmissible by [3]'s complete class theorem. 
Therefore a more challenging open problem is to find admissible estimators 
dominating the James-Stein estimator especially at \\6\\ = 0. In this paper, 
we will consider a class of estimators 

(1.9) UX) = J-'C °''P(-|I^IP^A/2)^A 

^ ^ ^ ' /(}A"(p/2-i)-iexp(-||X||2aA/2)dA 



Y. MARUYAMA/IMPROVING ON THE JSE 



5 



for a > 1. In Section 3, we show that 6a with a > 1 improves on the 
James-Stein estimator and that it has strictly risk improvement at \\6\\ = 0. 
Furthermore we see that 5a approaches 5'jg as a goes to oo. Since 6a with 
a = 1 corresponds to 6k, the class of 6a with a > 1 is a bridge between 6k 
which is admissible and 6jg which is inadmissible. Although we show that 
6a with a > 1 is quasi-admissible, which is introduced in Section 2, we have 
no idea on its admissibility at this stage. 

2. Quasi-admissibility. In this section, we introduce the concept of 
quasi-admissibility and give a sufficient condition for quasi-admissibility. We 
deal with a reasonable class of estimators which have the form 



where V is a differential operator (d/dxi, . . . ^d/dxp)' and m is a positive 
function. If m{w) = w~'^ for c > 0, (12. 1|) becomes the James-Stein type 
estimator (|1.6p . Any (generalized) Bayes estimator with respect to spherical 
symmetric measure vr should also have the form (12. Ih because it is written 
as 



/^pgexp(-||3;-g||72)7r(dg) 
Xfjpexp(-||x-e||V2)7r((i^) 

Srv{0 -x)e^^{-\\x-e\\'^/2)TT{de) 

!rv^M-\\x - ow^ /2)n{de) 
V jR,eM-\\x-ef/2)n{de) 

/^pexp(-||x-0||2/2)7r(d^) 
= x + Vlog/ exp(-||x - 6l||V2)vr((i6l) 



where m7r(||x|p) = /^p exp(— 6'|p/2)7r((i0). [3] and [sl] called an estimator 
of the form ()2.ip pseudo-Bayes and quasi-Bayes, respectively. If, for given 
m, there exists a nonnegative measure v which satisfies 



(2.1) 



<5^ = X + Vlogm(||Xf) 

= {l + 2m'(||Xf)M||Xf)}X 




x + V log m^(||a;|p) 



(2.2) 




the estimator of the form (j2.ip is truly generalized Bayes. However it is often 
difficult to determine whether or not m has such an exact integral form. 
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Suppose that 5m,k{X) = 5m{X) + k{\\Xf)X is a competitor of 5m- 
Then substituting (7(x) = V log m(|[a;|p) = 2a;m'(||xp)/m(||x|p) and ^'(x) = 
2xm'(||x|p)/m(||x|p) + /c(||3;|p)x in (jl.3p respectively, we have the unbiased 
estimators of risk as 

A,^ ^ fm'{w)\'^ m'iw) m"(w) 

2.3 R{S^)=p-4w{^^) +4p—^ + 8w^^ 

\ mlw) ) m[w) m[w) 

for w = and R{5m,k) = R{5m) + A{m,mk) where 

(2.4) A(m, mk) = Aw — ■^k{w) + 2pk{w) + Awk'{w) + wk'^{w). 

m[w) 

If there exists k such that A(m, mk) < for any w > with strict inequal- 
ity for some w , that implies that dm is inadmissible, that is, R{9, Smk) ^ 
R{6,6m) for all 9 with strict inequality for some 9. If there does not ex- 
ist such k, 5m is said to be quasi-admissible. Hence quasi- admissibility is a 
weaker optimality than admissibility. Now we state a sufficient condition for 
quasi-admissibility. The idea is originally from 0], but the paper is not so 
accessible. See also [13], where quasi-admissibility is called permissibility. 



Theorem 2.1. The estimator of the form (|2.ip is quasi- admissible if 



w ^^'^m{w) ^dw = 00 as well as w ^^'^m{w) ^dw 

Ji 



00. 



Proof. We have only to show that R{6m,k) < R{5m), that is, A(m, mk) < 
implies k{w) = 0. Let M{w) = w'P/'^m{w) and h{w) = M{w)k{w). Then 
we have 

,N . h'(w) h'^iw) Awh'^iw) f d ( 1 ] 1 



M{w) M'^{w) M{w) V dw{h{w)} iM{w) 

First we show that h{w) > for all w > 0. Suppose to the contrary that 
h{w) < for some wq. Then h{w) < for all w > wq since h'{w) should be 
negative. For all w > wq, the inequality 

(2^5) l(rL)> ' 



dw \h{w) J ~ 4:M{w) 
should be satisfied. Integrating both sides of (j2.5p from wq to w* leads to 
1 11 



h{w*) h{wo) 



1 

> - / M-^{t)dt. 
4 Jwo 



Y. MARUYAMA/IMPROVING ON THE JSE 



7 



As ij;* ^ oo, the right-hand side of above inequaUty tends to infinity, and 
this provides a contradiction since the left-hand side is less than —l/h{wQ). 
Thus we have g{w) > for all w. 

Similarly we can show that g{w) < for all w. It follows that h{w) is 
zero for all w, which implies that k{w) = for all w. This completes the 
proof. □ 

Combining Theorem 1 2 . 1 1 and ^'s sufficient condition for admissibility, we 
see that a quasi- admissible estimator of the form ()2.ip is admissible if it is 
truly generalized Bayes, that is, there exists a nonnegative measure u such 
that 



However, for given m, it is often quite difficult to determine whether m has 
such an integral form. Furthermore, even if we find that m does not have an 
integral form like ()2.6p . that is, the estimator is inadmissible, it is generally 
very difficult to find an estimator dominating the inadmissible estimator. 

The function m for the James-Stein estimator is m{w) = z/;^"^, which 
satisfies the assumptions of Theorem 12.11 

Corollary 2.1. The James-Stein estimator is quasi-admissible. 

In this case, it is not difficult to find an estimator dominating 6js by 
taking positive part. But it is not easy to find a large class of estimators 
dominating the James-Stein estimator. In Section 3, we introduce an elegant 
sufficient condition for domination over 6js proposed by 

3. A class of quasi-admissible estimators improving upon the 
James-Stein estimator. In this section, we introduce (9|'s sufficient con- 
dition for improving upon the James-Stein estimator and propose a class of 
smooth quasi-admissible estimators satisfying it. 

[1] showed that if limt^j^oo (/^{w) = p—2 then the difference of risk functions 
between 6 js and (5^ can be written as 



(2.6) 




R{e,6js)-R{9,6^) 
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where A = and fp{x;X) denotes a density of a non-central chi-square 
distribution with p degrees of freedom and non-centrahty parameter A. 
Moreover by the inequahty 

fp{w;X)/ y~^fp{y;X)dy>fp{w)/ y~^fp{y)dy, 



where fp{y) = /p(y;0), which can be shown by the correlation inequality, 
we have 

R{e,6js)-R{e,6^) 

POO / rw \ 

> 2 ^'{w) (cPiw) - Mw)) ^ y-^fp{y, X)dyj dw, 



where 



rw 

Mw) =p-2 + 2fp{w)/ / y-^fp{y)dy. 

Jo 



Since 0o = ^pK given in (jl.Sp by an integration by parts and lim^_»oo 4>k{w) = 
p — 2, we have the following result. 

Theorem 3.1 ([9(|). If 4>{w) is nondecreasing and within [(j)K{w),p — 
2] for any w > 0, then 6tf,{X) of form (jl.ip dominates the James-Stein 
estimator. 

The assumption of the theorem above is satisfied by (px and By 
(13. ip . we see that the risk difference at \\9\\ = between 5js and 5^, the 
limit of which is p — 2, is given by 

(3.2) 2 (t>'{w) (Hw) - cf>Kiw)) ^ y-'fp{y)dyj dw. 

Hence 6k does not improve upon 6js{X) at \\0\\ = 0, although dxiX) is 
an admissible generalized Bayes estimator and thus smooth. On the other 
hand, 6~jg{X) improves on 5js{X) significantly at the origin, but it is not 
analytic and is thus inadmissible by [3|'s complete class theorem. Therefore 
a more challenging problem is to find admissible estimators dominating the 
James-Stein estimator especially at ||^|| =0. 
In this paper, we propose a class of estimators 

(3.3) 6o^iX) = {l-M\\Xf)/\\Xf)x 



Y. MARUYAMA/IMPROVING ON THE JSE 



9 



where 



^ /,^A"W^-^)exp(-z.«A/2)dA 
' /o A"(p/2-i)-i exp(-^l;aA/2)dA 
2 exp(— u;a/2) 



p-2 



a/o A°(p/2-i)-i exp(-ti;aA/2)(iA 
(3.4) =p-2 ^ 



a/o^(l - A)°(p/2-i)~i exp(ti;aA/2)(iA' 
The main theorem of this paper is as follows. 

Theorem 3.2. 1. 5a{X) dominates 6js{X) for a > 1. 

2. The risk of 5a{X) for a> \ at \\9\\ = is strictly less than the risk of 
the James-Stein estimator at \\9\\ = 0. 

3. Sa{X) approaches the positive-part James-Stein estimator when a tends 
to infinity, that is, 



Clearly di{X) = dxiX). The class of 6a with a > 1 is a bridge between 

+ 
JS 



5k which is admissible and Jte which is inadmissible. 



Proof, [part 1] We shall verify that (paiw) for a > 1 satisfies assump- 
tions in Theorem 13. II Applying the Taylor expansion to a part of p.4p . we 
have 

- /V-A)"(P/2-^)~^exp(u'aA/2)dA 
2 Jo 

oo i 

= II^'n(^'-2 + 2j7a)"^ =^(a,tt^) (say.) 

i=0 j=0 

As ip{a, w) is increasing in w, (j)a{w) is increasing in w. As lim^^oo fp{ct, w) = 
oo, for any a > 1, it is clear that lim^o^oo (t>a{w) = p — 2. In order to show 
that (paiw) > 4>k{w) = 4>i{vo) for a > 1, we have only to check that ilj{a, w) 
is increasing in a. It is easily verified because the coefficient of each term of 
il^{a, w) is increasing in a. We have thus proved the theorem. 

[part 2] Since (pa for a > 1 is strictly greater than cpK and strictly in- 
creasing in w, the risk difference of 6a for a > 1 and 6js at ||0|| = 0, which 
is given in (13. 2p . is strictly positive. 
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[part 3] Since 1^(0,10) is increasing in a, it converges to 



(p-2)-^E 



i=0 



w 



p-2 



by the monotone convergence theorem when a goes to infinity. Considering 
two cases: w < {>)p — 2, we obtain hmQ,_»oo 4>a{w) = w if w < p — 2; = p — 2 
otherwise. This completes the proof. □ 

The estimator 6a is expressed as X + Vlogma(||X|p) where 
ma{w) = jj^' A°(^/2-i)-i exp (-^a) ^a}'^" . 

Since ma{w) ~ w'^~'^ for sufficiently large w by Tauberian's theorem and 
< rn-Q,(0) < cxD, we have the following result by Theorem 12.11 

Corollary 3.1. Sa{X) is quasi- admissible for p > 3. 

Needless to say, we are extremely interested in determining whether or not 
5a{X) for a > 1 is admissible. Since 5aiX) with a > 1 is quasi-admissible, 
it is admissible if it is generalized Bayes, that is, there exists a measure 
which satisfies 



l/a 



I have no idea on the way to construct such a measure v so far. Even if we 
find that there is no z/, which implies Sa is inadmissible, it is very difficult 
to find an estimator dominating 6a for a > 1. 
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